Contrastive Hebbian learning with random feedback weights
نویسندگان
چکیده
منابع مشابه
Random feedback weights support learning in deep neural networks
The brain processes information through many layers of neurons. This deep architecture is representationally powerful1,2,3,4, but it complicates learning by making it hard to identify the responsible neurons when a mistake is made1,5. In machine learning, the backpropagation algorithm1 assigns blame to a neuron by computing exactly how it contributed to an error. To do this, it multiplies error...
متن کاملContrastive Hebbian Learning in the Continuous Hopfield Model
This pape.r shows that contrastive Hebbian, the algorithm used in mean field learning, can be applied to any continuous Hopfield model. This implies that non-logistic activation functions as well as self connections are allowed. Contrary to previous approaches, the learning algorithm is derived without considering it a mean field approximation to Boltzmann machine learning. The paper includes a...
متن کاملRandom synaptic feedback weights support error backpropagation for deep learning
The brain processes information through multiple layers of neurons. This deep architecture is representationally powerful, but complicates learning because it is difficult to identify the responsible neurons when a mistake is made. In machine learning, the backpropagation algorithm assigns blame by multiplying error signals with all the synaptic weights on each neuron's axon and further downstr...
متن کاملUsing Contrastive Hebbian Learning to Model Early Auditory Processing
We present a model of early auditory processing using the Symmetric Diffusion Network (SDN) architecture, a class of multi-layer, parallel distributed processing model based on the principles of continuous, stochastic, adaptive, and interactive processing [Movellan & McClelland, 1993]. From a computational perspective, a SDN can be viewed as a continuous version of the Boltzmann machine; that i...
متن کاملHebbian Learning and Negative Feedback Networks
Spend your few moment to read a book even only few pages. Reading book is not obligation and force for everybody. When you don't want to read, you can get punishment from the publisher. Read a book becomes a choice of your different characteristics. Many people with reading habit will always be enjoyable to read, or on the contrary. For some reasons, this hebbian learning and negative feedback ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Networks
سال: 2019
ISSN: 0893-6080
DOI: 10.1016/j.neunet.2019.01.008